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ABSTRACT 


The fingerprint identification is the most widely used authentication system. 
The fingerprint uniqueness for each human being provides error-free 
identification. However, during the scanning process of the fingerprint, the 
generated image using the fingerprint scanner may differ slightly during 
each scan. This paper proposes an efficient matching model for fingerprint 
authentication using deep learning based deep convolutional neural network 
(CNN or ConvNet). The proposed deep CNN consists of fifteen layers and is 
classified into two stages. The first stage is preparation stage which includes 
the fingerprint images collection, augmentation and pre-processing steps, 
while the second stage is the features extraction and matching stage. 
Regarding the implantation results, the proposed system provided the best 
matching for the given fingerprint features. The obtained training accuracy 


Fingerprint of the proposed model is 100% for training dataset and 100% for validating 
Recognition dataset. 
This is an open access article under the CC BY-SA license. 
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1. INTRODUCTION 

Biometrics identification technology are important in security systems of different applications to 
reduce security threats of military applications, government centers and airports, and criminal applications 
[1], [2]. Accordingly, the need of safe, reliable, and convenient a identify identification system. Many 
fingerprint recognition algorithms have been suggested. Park et al. [3] proposed a fingerprint recognition 
system using feature detection algorithm based on scale-invariant feature transform. Cappelli et al. [4] 
presented a new 3D data structure based on minutiae distances and angles named minutiae -cylinder-code. 
Patil and Suralkar [5] presented fingerprint classification using a neural network. The neural network 
performed matching step and was successfully used for identifying and classifying the fingerprint utilizing 
back propagation algorithm. Although many of the previous work has achieved high performance precision, 
but it involves a lot of pre-processing, which may not be suitable for data sets of different fingerprints under 
different conditions. recently, efforts have been made for developing recognition models for learning and 
features extraction automatically [6], [7]. Recently, the emergence of the deep learning technology has great 
successful achievement in different applications such as image processing, natural language processing and 
so on [7]. As a results, the fingerprint classification based deep neural network can be also achieved good 
results. Minaee et al. [8] proposed fingerprint recognition model utilizing convolutional neural network 
(CNN) by tuning trained CNN model on ImageNet and applied the proposed model of the PolyU fingerprint 
database. Das et al. [9] proposed deep learning model based on finger-vein identification and obtained highly 
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accurate and stable performance using different finger-vein images with different quality. Militello et al. [10] 
has presented fingerprint classification systems using deep learning based CNN using two datasets of 
fingerprint called PolyU and national institute of standards and technology (NIST) and introduced 
comparisons study with ResNet, AlexNet, and GoogLeNet. Pandya et al. [11] has proposed fingerprint 
classification systems using deep learning based deep CNN using thinning of fingerprint, and Gabor 
improvement, histogram equalization. 

In [12], [13] proposed a new COVID-19 detection model based on histogram techniques and new 
CNN architecture for improving the images contrast and for COVID-19 detection in chest X-ray image, 
respectively. Oleiwi and Althabhawee [14] has presented new architecture of CNN for matching the human 
iris imges in authentication system. In [15], [16] introduced hybrid approach based on deep learning and 
imag preprocessing for noisy iris dataset. In [17], [18] have proposed sentiment analysis system using deep 
learning, for Arabic language [17] and for American sign language as static letters (ASL) in hand gesture 
recognition [18]. In [19], [20] has suggested real time assistive blind model for object detection using deep 
learning based YOLO algorithm and raspberry model B pi 3. Mahmood and Saud [21] presented monitoring 
System based detection and classification for moving cars in streaming video. In this paper, the deep learning 
model based deep CNN is suggested for matching between the samples of presented fingerprint images. The 
fingerprint database is collected using fingerprint sensor. The fingerprint image augmentation and pre- 
processing is applied in order to expand and enhance the images. Then, the features extracted using deep 
CNN and after that, the Softmax performed as a recognizer. The paper is structured as: section 2 introduces 
the proposed fingerprint recognition system. Section 3 explains the CNN overview and its architecture, and 
section 4 gives simulation results and discussion. Finally, section 5 presents the conclusion part for the study. 


2. THE PROPOSED FINGERPRINT RECOGNITION MODEL 

Fingerprint image recognition plays an important role in automated fingerprint identification system, 
especially in the large dataset. With development of identification system of fingerprint based on big 
fingerprint database, the accuracy and fast processing time are required. The proposed model is comprised of 
the following phases. 


2.1. Fingerprint dataset acquisition 

There are different visual fingerprint patterns that unequally distributed. Thus, the fingerprint types 
can be divided into five types [2]; the right loop, left loop, the whorl arch and tented arch. In the initialization 
stage, the fingerprint database of the authorized users was collected using fingerprint sensor named ZKT 
ZK4500 as a USB fingerprint sensor [22]. The collected dataset includes 1,500 images for 15 authorized 
users with different ages, each one has 100 samples of his 10 fingers. Some images of the collected dataset 
are presented in Figure 1, as can be noticed in this figure, there are slightly different colour distributions and 
different sizes. 
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Figure 1. Eighteen fingerprint images using fingerprint sensor 
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2.2. Data augmentation and preprocessing 

The fingerprint images augmentation and pre-processing step is important process in order to 
enlarge and enhance the dataset before feeding the dataset to the network. Essentially it applies random 
rotations, shifts, flips, crops, and sheers on fingerprint images. The fingerprint images in the dataset are 
converted from red, green, and blue (RGB) to grayscale images with pixel values ranging from 0 to 255 and 
resized to a uniform dimension images of size 360X280. 


2.3. The matching process 

The global and local features of the collected fingerprint images will be extracted using deep CNN. 
Hence, the representations of the structured feature template data stored in the database, as will be explained 
in the next section. The matching process is responsible for comparing the stored image and inputted image 
in order to achieve a verdict match or non-match. Hence, the entered fingerprint image scanned using 
fingerprint sensor and the feature extraction implemented through the same process in the initialization stage, 
as illustrated in Figure 2. 
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Figure 2. General block diagram of the proposed recognition system 


3. OVERVIEW OF CNN 

The deep learning field represents a subfield of machine learning concerning with algorithms that 
inspired by human brain structure and function which is named artificial neural networks. Deep-learning 
methods such as CNN consists of a multi convolutional layers with a fully connected layer, based a robust 
method of feature extraction and classification [9], [23], [24]. The CNN layers will be explained as: 

— Convolutional layers: represent a several 2-D convolutional layers started from the input maps x4,, 
where | and m represent indexes of the level and map respectively. The filters based on the 
kernels Wh sas where n is the index of the filter. The nth is the output map yj, of layer 1 which can be 
calculated as [9], [25]: 


mMi-1 


yh =). Whim * th + Bh 
™ (1) 


Where M'~? denotes input maps number, * is convolution, and b4,, represents bias of nth map output in 
the /th level. 

— The rectified linear unit (ReLU) layer: represents activation layer as nonlinear layer which is used 
directly after the convolutional layer mentioned by (1). This layer allows model to train faster with high 
accuracy. By applying activation function in (2). 


Softmax[f (x) = max(0,x)] (2) 


which will be increased as non-linearity. 


— Pooling layer: This layer minimizes the spatial size, by reducing the required parameters number for 
describing the network, which led to reduce the computational process that are required for training the 
model. 
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— Fully connected layer: fully connected of all neurons as in ordinary neural systems. It represents the last 
part of the network, for yielding the probabilities of the class. The linear combination O,, is expressed in 
(3), where x,, is the mth map input in the output layer [9], [26]. The high level features will be extracted 
in this layer by calculating probabilities of the available classes. The probability distribution of the input 
data over C different classes will be predicted by using the Softmax function, as defined in (4): 


M 
On = y (Wrm *Xm + bn) 
m=1 (3) 


exp (0,) 
Pu = So_, exp (On) (4) 


3.1. Designed CNN architecture 

The structure of the designed CNN for performing fingerprint recognition system consists mainly of 
convolutional layer, pooling layer, fully connected layer and the activation functions as illustrated in 
Figure 3. The defined 2 D CNN strucure has fifteen Layers: image input as gray image with size 360, 280, 
bl, then 3 convolution layers for extracting the features based on different sizes, strides and padding, 
followed by 3 RelU layers as activation functions, after that 3-max pooling layeras for reducing the 
parameters, fully connected layers, softmax layer and classification layer as introduced in Figure 4. Figure 5 
represents the options set chosen for training the proposed CNN. 
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Figure 3. Employed CNN architecture 


layers = 


15x1 Layer array with layers: 


z Image Input 360x28@x1 images with ‘zerocenter’ normalization 

2 Convolution 32 5x5 convolutions with stride [1 1] and padding [2 2 2 2] 
3 ReLU ReLU 

4 Max Pooling 3x3 max pooling with stride [2 2] and padding [0 ® ® 8] 

5 Convolution 32 5x5 convolutions with stride [1 1] and padding [2 2 2 2] 
6 ReLU ReLU 

7 Max Pooling 3x3 max pooling with stride [2 2] and padding [@ @ @ @] 

8 Convolution 64 5x5 convolutions with stride [1 1] and padding [2 2 2 2] 
9 ReLU ReLU 

1@  ‘* Max Pooling 3x3 max pooling with stride [2 2] and padding [@ @ @ @] 

11 ral Fully Connected 64 fully connected layer 

12 ‘* ~~ ReLU ReLU 

13 ue Fully Connected 3 fully connected layer 

14 an Softmax softmax 

15 ‘* Classification Output  crossentropyex 


Figure 4. The defined CNN fifteen layers 


3.2. Software part of the CNN 

The basic steps of the software part of the fingerprint identification system using CNN based multi 
layers are presented in flowchart in Figure 6. In the first step of this flowchart, the inputted image was 
recorded and read, then converted it from a color image to a gray image, and then CNN is applied for the 
purpose of detecting and classifing the inputted fingerprint if it matches the stored fingerprints or not. In the 
last stage, the detected image is classified into which class belongs of the stored fingerprints with rating ratio 
for each fingerprint stored in the dataset. 
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Momentum: 
InitialLearnRate: 
LearnRateScheduleSettings: 
L2Regularization: 
MaxEpochs: 
MiniBatchSize: 
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VerboseFrequency: 
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ValidationPatience: 
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Figure 5. The options set chosen for training the CNN network 
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Figure 6. Flowchart of the fingerprint identification system using CNN 


4. RESULTS AND DISCUSSION 

The implementatin of the introduced model required two parts, software and hardware. The software 
part using MATLAB version 2020b [25], [27], and the hardware part using a PC assembled specially for the 
work with core 15 CPU composed of four 3.2 GHz working cores, a 10 GB RAM, and an advanced GPU of 
6.1 computation capability measure. The proposed model are implemented in parallel computing fashion in 
which the four CPU cores and the GPU cooperate together. 

In the initialization stage, the fingerprint images of the authorized users will be collected by 
fingerprint sensor. The features of the collected fingerprint image will be extracted, and then the comparison 
step in the matching stage. The template or inputted image will be compared with the stored dataset in order 
to achieve the matching outcome process. Hence, the query fingerprint image is scanned using fingerprint 
sensor. The feature extraction of the query fingerprint image implement using the same procedures in the 
initialization stage. The simulation has been carried out to evaluate the performance of the proposed system 
based on special fingerprint database. The fingerprint images have been acquired and quantized according to 
360X280 and 256 gray. Figure 7 includes of patterns of the database that has been used for training process. 
While Figure 8 represents the performance of the proposed system, Figure 8(a). Training on single GPU, 
Figure 8(b). Training progress. Finally, the Fingerprint recognition has been represented in Figure 9. The 
obtained results indicated the success of the proposed model in achieving its intended in classification and 
identification of the fingerprint. Hence, the proposed system managed to achieve complex computations in 
relatively short times. 
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Figure 7. Patterns of the database that has been used for training process 
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Figure 8. The performance of the proposed system for (a) training on single GPU and (b) training progress 
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Figure 9. Fingerprint classification 


5. CONCLUSION 

In this paper, a deep learning framework for fingerprint recognition using CNN to learn the 
representation of the features and perform the recognition. The proposed model has been trained on a large- 
scale fingerprint recognition dataset. The successful simulation results have been indicated that the proposed 
system can be applied as a reliable system for developing artificial identification and can be adapted to any 
image contents of different characteristics. The accuracy of the proposed system according to training model 
was 100% for training dataset and 100% for validation dataset. Therefore, the proposed system is robust, 
reliable, efficiency. In future research, CNN structure optimization will be study to speed up the learning 
speed for fast matching and to improve the recognition performance of images with noise, to apply multi 
modal biometric recognition and implement in real time using Raspberry pi and fingerprint sensor. 
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